Information processing apparatus, stereoscopic display method, and program

ABSTRACT

A method is provided for displaying content to a user. The method comprises displaying content in a first position. The method further comprises detecting an operating member, and determining a distance between the member and a device. The method still further comprises displaying if the distance between the member and the device is less than a predefined distance, the content in a second position appearing to be behind the first position, with respect to the user.

CROSS-REFERENCE TO PRIOR APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/604,936 (filed on May 25, 2017), which is a continuation of U.S.patent application Ser. No. 13/197,481 (filed on Aug. 3, 2011 and issuedas U.S. Pat. No. 9,678,655 on Jun. 13, 2017), which claims priority toJapanese Patent Application No. 2010-192248 (filed on Aug. 30, 2010),all of which are hereby incorporated by reference in their entirety.

BACKGROUND

The present disclosure relates to an information processing apparatus, astereoscopic display method, and a program.

In recent years, stereoscopic display apparatuses capable ofstereoscopically displaying a display object such as video content, anoperation object or the like are put to practical use, and are becomingwidespread. For example, there are several display apparatuses fortelevisions, portable game machines and personal computers (hereinafter,PCs) capable of stereoscopic display that are already in the market. Itis expected that non-stereoscopic display apparatuses currently widelyused will be gradually replaced by the stereoscopic display apparatusesin the future. In relation to such stereoscopic display apparatuses, JP2010-045584A discloses a method of correcting a stereoscopic image thatenables to accurately express the pop-out amount, pull-in amount or thelike intended by the creator of a display object.

SUMMARY

As described, a stereoscopic display technology itself is widely known,but there exist various issues caused due to stereoscopic display. Forexample, when an object in the real world overlaps with a display objectwhich is stereoscopically displayed, there arises an issue that amismatch, regarding the sense of distance, occurs between the objectactually having a three-dimensional shape and the display object whichis stereoscopically shown by virtually realizing a parallax, therebygiving a viewing user an odd feeling. In light of the foregoing, it isdesirable to provide an information processing apparatus, a stereoscopicdisplay method, and a program which are novel and improved, and whichare capable of reducing an odd feeling experienced by a user when anobject in the real world nears a display screen on which a displayobject is stereoscopically displayed.

Accordingly, there is provided a method for displaying content to auser. The method comprises displaying content in a first position. Themethod further comprises detecting an operating member; and determininga distance between the member and a device. The method still furthercomprises displaying, if the distance between the member and the deviceis less than a predefined distance, the content in a second positionappearing to be behind the first position, with respect to the user.

In a second aspect, there is provided a non-transitory computer-readablemedium storing instructions which, when executed by a processor, performa method of displaying content to a user. The method comprisesdisplaying content in a first position. The method further comprisesdetecting an operating member, and determining a distance between themember and a device. The method still further comprises displaying, ifthe distance between the member and the device is less than a predefineddistance, the content in a second position appearing to be behind thefirst position, with respect to the user.

In a third aspect, there is provided an apparatus for displaying contentto a user, comprising a memory and a processor executing instructionsstored in the memory. The processor executes instructions stored in thememory to display content in a first position. The processor furtherexecutes instructions stored in the memory to detect an operatingmember; and determine a distance between the member and a device. Theprocessor still further executes instructions stored in the memory todisplay, if the distance between the member and the device is less thana predefined distance, the content in a second position appearing to bebehind the first position, with respect to the user.

According to the embodiments of the present disclosure described above,it is possible to reduce an odd feeling experienced by a user when anobject in the real world nears a display screen on which a displayobject is stereoscopically displayed.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an explanatory diagram for describing a functionalconfiguration of a stereoscopic display apparatus according to anembodiment of the present disclosure;

FIG. 2 is an explanatory diagram for describing a principle ofstereoscopic display;

FIG. 3 is an explanatory diagram for describing a display control method(#1) according to the embodiment;

FIG. 4 is an explanatory diagram for describing an operation (#1) of thestereoscopic display apparatus according to the embodiment;

FIG. 5 is an explanatory diagram for describing a display control method(#1 (modified example)) according to the embodiment;

FIG. 6 is an explanatory diagram for describing an operation (#1(modified example)) of the stereoscopic display apparatus according tothe embodiment;

FIG. 7 is an explanatory diagram for describing a display control method(#2) according to the embodiment;

FIG. 8 is an explanatory diagram for describing an operation (#2) of thestereoscopic display apparatus according to the embodiment;

FIG. 9 is an explanatory diagram for describing a display control method(#2 (modified example)) according to the embodiment;

FIG. 10 is an explanatory diagram for describing an operation (#2(modified example)) of the stereoscopic display apparatus according tothe embodiment;

FIG. 11 is an explanatory diagram for describing a display controlmethod (#3) according to the embodiment;

FIG. 12 is an explanatory diagram for describing an operation (#3) ofthe stereoscopic display apparatus according to the embodiment;

FIG. 13 is an explanatory diagram for describing a display controlmethod (#3 (modified example)) according to the embodiment;

FIG. 14 is an explanatory diagram for describing an operation (#3(modified example)) of the stereoscopic display apparatus according tothe embodiment; and

FIG. 15 is an explanatory diagram for describing an example hardwareconfiguration of an information processing apparatus capable ofrealizing a function of the stereoscopic display apparatus according tothe embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENT(S)

Hereinafter, embodiments of the present disclosure will be described indetail with reference to the appended drawings. Note that, in thisspecification and the appended drawings, structural elements that havesubstantially the same function and structure are denoted with the samereference numerals, and repeated explanation of these structuralelements is omitted.

[Flow of Explanation]

The flow of explanation on an embodiment of the present disclosure whichwill be described below will be briefly stated here. First, a functionalconfiguration of a stereoscopic display apparatus 100 according to theembodiment will be described with reference to FIG. 1. At the same time,a principle of stereoscopic display will be briefly described withreference to FIG. 2. Then, a display control method according to theembodiment and an operation of the stereoscopic display apparatus 100for realizing the display control method will be described withreference to FIGS. 3 to 14. Then, an example hardware configuration ofan information processing apparatus capable of realizing a function ofthe stereoscopic display apparatus 100 will be described with referenceto FIG. 15. Lastly, technical ideas of the embodiment will be summarizedand effects obtained by the technical ideas will be briefly described.

(Description Items)

1: Embodiment

1-1: Functional Configuration of Stereoscopic Display Apparatus 100

1-2: Display Control Method and Operation of Stereoscopic DisplayApparatus 100

-   -   1-2-1: (#1) Non-Stereoscopic Display of Display Object    -   1-2-2: (#2) Inward Pushing of Display Object    -   1-2-3: (#3) Blurry Display of Display Object

1-3: Hardware Configuration

2: Summary 1: EMBODIMENT

An embodiment of the present disclosure will be described. The presentembodiment proposes a display control method capable of reducing an oddfeeling experienced by a user when an object in the real world nears adisplay object, that is, content, which is stereoscopically displayed.

[1-1: Functional Configuration of Stereoscopic Display Apparatus 100]

First, a functional configuration of a stereoscopic display apparatus100 capable of realizing the display control method according to thepresent embodiment will be described with reference to FIG. 1. FIG. 1 isan explanatory diagram for describing a functional configuration of thestereoscopic display apparatus 100 according to the present embodiment.

As shown in FIG. 1, the stereoscopic display apparatus 100 is mainlyconfigured from a touch panel 101, a display control unit 102, a storageunit 103, and a stereoscopic display unit 104.

Additionally, the touch panel 101 corresponds to an input unit 916 inthe hardware configuration described later. Also, the function of thedisplay control unit 102 is realized by using a CPU 902 or the like inthe hardware configuration described later. Furthermore, the function ofthe storage unit 103 is realized by a ROM 904, a RAM 906, a storage unit920 or a removable recording medium 928 in the hardware configurationdescribed later. Furthermore, the function of the stereoscopic displayunit 104 is realized by an output unit 918 in the hardware configurationdescribed later.

The touch panel 101 is means for detecting nearing of an operating tool,i.e., an operating member. The touch panel 101 is provided on a displayscreen, that is, a device, of the stereoscopic display unit 104. Thetouch panel 101 detects the position of an operating tool which hasneared the display screen of the stereoscopic display unit 104. Thetouch panel 101 may also have a function of detecting a distance betweenthe operating tool which has neared the display screen of thestereoscopic display unit 104 and the display screen. Furthermore, thetouch panel 101 may also have a function of detecting the pressure ofthe operating tool pressing the display screen of the stereoscopicdisplay unit 104. The functions of the touch panel 101 are realized by acapacitive touch panel or an optical touch panel, for example.

The capacitive touch panel is for detecting a capacitance occurringbetween the touch panel and the operating tool and detecting, from thechange in the capacitance, the nearing or contacting of the operatingtool. When the distance between the touch panel and the operating toolchanges, the capacitance occurring between them also changes. It is alsoknown that when the touch panel is pressed by the operating tool, thecapacitance occurring between them changes according to the pressing.Accordingly, when using the capacitive touch panel, not only is thenearing of the operating tool to the touch panel detected, but also thedistance between the operating tool and the touch panel and the pressureof the operating tool pressing the touch panel can be detected.

On the other hand, the optical touch panel is for detecting, by anoptical sensor, an operating tool which has neared or contacted thetouch panel. Various types of optical touch panels are known, andrecently, an optical touch panel called “in-cell type” was developed.The in-cell optical touch panel emits light on the operating tool fromthe inside of a display panel and detects the position of the operatingtool by detecting the light reflected by the operating tool. When theoperating tool is present near the display panel, light is stronglyreflected by the operating tool. Accordingly, the distance between thedisplay panel and the operating tool can be detected based on theintensity of the light reflected by the operating tool.

When the nearing or contacting of the operating tool is detected by thetouch panel 101, information indicating the nearing or contacting of theoperating tool (hereinafter, proximity information) is input from thetouch panel 101 to the display control unit 102. Position informationindicating the position of the operating tool or the like is also inputto the display control unit 102 from the touch panel 101.

When the proximity information, the position information or the like isinput, the display control unit 102 controls display of an displayobject by the stereoscopic display unit 104 according to the proximityinformation, the position information or the like which has been input.The display control unit 102 is means for causing the stereoscopicdisplay unit 104 to display the display object.

For example, the display control unit 102 reads image data stored in thestorage unit 103 and causes the stereoscopic display unit 104 to displaythe image data that has been read. Also, the display control unit 102causes the stereoscopic display unit 104 to display video content, a GUI(Graphical User Interface) or the like. At this time, the displaycontrol unit 102 performs operation for stereoscopically displaying adisplay object such as the image data, the video content, the GUI or thelike. For example, the display control unit 102 performs operation forcausing the display object to pop out of the display screen of thestereoscopic display unit 104 or to be pushed inward into the displayscreen.

A principle of the stereoscopic display will be briefly described herewith reference to FIG. 2. FIG. 2 is an explanatory diagram fordescribing a principle of the stereoscopic display.

As shown in FIG. 2, to stereoscopically show a display object, a displayobject for a right eye and a display object for a left eye are displayedseparately from each other on the display screen, and the display objectfor a right eye is made to be seen only by the right eye and the displayobject for a left eye is made to be seen only by the left eye. In manycases, polarized light is used to cause the display object for a righteye to be seen only by the right eye and the display object for a lefteye to be seen only by the left eye. For example, the display object fora right eye is displayed with light linearly polarized in a firstdirection, and the display object for a left eye is displayed with lightlinearly polarized in a second direction orthogonal to the firstdirection. Furthermore, by having a lens that lets the light that islinearly polarized in the first direction pass through worn on the righteye and a lens that lets the light that is linearly polarized in thesecond direction pass through worn on the left eye, a situation can becreated where the display object for a right eye is seen only by theright eye and the display object for a left eye is seen only by the lefteye.

When such a situation is created, a display object will be seendisplayed at a position where a line of sight connecting the right eyeand the display object for a right eye and a line of sight connectingthe left eye and the display object for a left eye intersect.Furthermore, an angle of convergence can be adjusted by controlling thedistance between the display object for a right eye and the displayobject for a left eye. The degree of pop-out of the display object thatis stereoscopically displayed will change when the angle of convergencechanges.

That is, by controlling the display positions of the display objects forright and left eyes on the display screen, the degree of pop-out or thedegree of inward-push of the display object that is stereoscopicallydisplayed can be controlled. Additionally, a method of realizingstereoscopic display by using polarized light is described here, but thepresent embodiment is not limited to such, and any display controlmethod capable of stereoscopically displaying a display object can beapplied.

FIG. 1 will be again referred to. As described above, the displaycontrol unit 102 stereoscopically displays a display object bycontrolling display of the display objects for right and left eyes.Information on the degree of pop-out or the degree of inward-push of thedisplay object determined by the display control unit 102 (hereinafter,control information) is input to the stereoscopic display unit 104. Dataon the display object read by the display control unit 102 from thestorage unit 103 is also input to the stereoscopic display unit 104.When the control information is input, the stereoscopic display unit 104displays the display object based on the control information that isinput.

In the foregoing, the functional configuration of the stereoscopicdisplay apparatus 100 has been described.

[1-2: Display Control Method and Operation of Stereoscopic DisplayApparatus 100]

Next, a display control method according to the present embodiment andan operation of the stereoscopic display apparatus 100 for realizing thedisplay control method will be described with reference to FIGS. 3 to14. The display control method described below is for reducing an oddfeeling experienced by a user when an object in the real world nears adisplay object that is stereoscopically displayed.

(1-2-1: (#1) Non-Stereoscopic Display of Display Object)

First, FIG. 3 will be referred to. The display control method describedhere is for switching, when an operating tool F nears the display screenof the stereoscopic display unit 104, a display mode of a display objectthat is stereascopically displayed, i.e., a three-dimensional image, tonon-stereoscopic display. FIG. 3 is an explanatory diagram fordescribing this display control method. Additionally, a stereoscopicdisplay object that is viewed by a user is schematically shown in FIG.3.

It is assumed as shown in FIG. 3 that a display object isstereoscopically displayed by the stereoscopic display unit 104 (Step.1). When an operating tool F nears the display screen of thisstereoscopic display unit 104 (Step. 2), the display control unit 102switches the display mode of the display object that is stercoscopicallydisplayed to non-stereoscopic display (Step. 3). When the display modeis switched to non-stereoscopic display in Step. 3, no mismatch willoccur between the sense of distance to the display object and the senseof distance to the operating tool F. As a result, a user will notexperience an odd feeling when the operating tool F nears the displayobject that is stereoscopically displayed.

In the foregoing, the display control method according to the presentembodiment has been described.

Next, FIG. 4 will be referred to. FIG. 4 is an explanatory diagramshowing an operation of the stereoscopic display apparatus 100 forrealizing the display control method which has been described withreference to FIG. 3.

As shown in FIG. 4, the stereoscopic display apparatus 100stereoscopically displays a display object on the stereoscopic displayunit 104 by using a function of the display control unit 102 (S101).Next, the stereoscopic display apparatus 100 detects whether or not anoperating tool F has neared the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S102). Inthe case an operating tool F has neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100proceeds with the process to step S103. On the other hand, in the casean operating tool F has not neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100returns the process to step S102.

When the process proceeds to step S103, the stereoscopic displayapparatus 100 switches the display mode of the display object that isstereoscopically displayed to non-stereoscopic display, by using afunction of the display control unit 102 (S103). Next, the stereoscopicdisplay apparatus 100 detects whether or not the operating tool F hasbeen removed from the display screen of the stereoscopic display unit104, by using a function of the touch panel 101 (S104).

In the case the operating tool F has been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 proceeds with the process to step S105. On the other hand,in the case the operating tool F has not been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 returns the process to step S104. In the case the processproceeds to step S105, the stereoscopic display apparatus 100 switchesthe display mode of the display object that is non-stereoscopicallydisplayed, i.e., a two-dimensional image, to stereoscopic display, byusing a function of the display control unit 102 (S105).

In the foregoing, an operation of the stereoscopic display apparatus 100according to the present embodiment has been described.

Modified Example

Next, FIG. 5 will be referred to. FIG. 5 is a modified example of thedisplay control method shown in FIG. 3. The display control method whichwill be described here is for switching the display mode of a displayobject to non-stereoscopic display when an operating tool F nears thedisplay screen, and pushing the display object inward into the displayscreen when the operating tool F contacts the display screen. FIG. 5 isan explanatory diagram for describing this display control method.Incidentally, only the operations following Step. 1 and Step. 2 shown inFIG. 3 are shown in FIG. 5. Thus, FIG. 3 will be referred to in relationto the operations of Step. 1 and Step. 2.

It is assumed as shown in FIG. 3 that a display object isstereoscopically displayed by the stereoscopic display unit 104 (Step.1). When an operating tool F nears the display screen of thisstereoscopic display unit 104 (Step. 2), the display control unit 102switches the display mode of the display object that is stereoscopicallydisplayed to non-stereoscopic display (Step. 3). Then, as shown in FIG.5, when the operating tool F contacts the display screen of thestereoscopic display unit 104, the display control unit 102 switches thedisplay mode of the display object that is non-stereoscopicallydisplayed to stereoscopic display (Step. 4). However, the displaycontrol unit 102 causes the display object to be displayed in such a waythat the display object is pushed inward into the display screen of thestereoscopic display unit 104.

In a case the display object is small, the display object may be hiddenby the operating tool F when the operating tool F contacts the displayscreen of the stereoscopic display unit 104. However, as shown in FIG.5, with the display object being pushed inward into the display screenfollowing contact of the operating tool F, the display object isprevented from being hidden by the operating tool F. In FIG. 5, thedisplay object is schematically displayed so as to be visible to a user,but in reality, the display object for a right eye and the displayobject for a left eye are displayed projecting on the left and right ofthe operating tool F. Accordingly, even if the display object is small,the display object will not be completely hidden by the operating toolF.

Such a display control method functions effectively in a situation wherea display object, such as a button object, a menu object or the like, isto be operated by the operating tool F. This display control methodfunctions effectively also in a situation where operation is performedover a certain period of time with the display object being contacted.For example, in a case of dragging the display object, the operatingtool F has to be moved while being in contact with the display object.In such a case, if the display object is hidden by the operating tool F,it becomes difficult to see whether or not the display object is incontact with the operating tool F. However, when the display controlmethod described above is applied, the movement of the display objectmoving following the operating tool F can be seen, and a user canconfidently perform a drag operation.

In the foregoing, a modified example of the display control methodaccording to the present embodiment has been described.

Next, FIG. 6 will be referred to. FIG. 6 is an explanatory diagramshowing an operation of the stereoscopic display apparatus 100 forrealizing the display control method which has been described withreference to FIGS. 3 and 5.

As shown in FIG. 6, the stereoscopic display apparatus 100stereoscopically displays a display object on the stereoscopic displayunit 104 by using a function of the display control unit 102 (S111).Then, the stereoscopic display apparatus 100 detects whether or not anoperating tool F has neared the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (SI 12). Inthe case an operating tool F has neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100proceeds with the process to step S113. On the other hand, in the casean operating tool F has not neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100returns the process to step S112.

When the process proceeds to step S113, the stereoscopic displayapparatus 100 switches the display mode of the display object that isstereoscopically displayed to non-stereoscopic display, by using afunction of the display control unit 102 (S113). Then, the stereoscopicdisplay apparatus 100 detects whether or not the operating tool F hascontacted the display screen of the stereoscopic display unit 104, byusing a function of the touch panel 101 (S114). In the case theoperating tool F has contacted the display screen of the stereoscopicdisplay unit 104, the stereoscopic display apparatus 100 proceeds withthe process to step S115. On the other hand, in the case the operatingtool F has not contacted the display screen of the stereoscopic displayunit 104, the stereoscopic display apparatus 100 returns the process tostep S114.

When the process proceeds to step S115, the stereoscopic displayapparatus 100 switches the display mode of the display object that isnon-stereoscopically displayed to stereoscopic display, by using afunction of the display control unit 102 (S115). At this time, thestereoscopic display apparatus 100 stereoscopically displays the displayobject in such a way that the display object is pushed inward into thedisplay screen of the stereoscopic display unit 104. Then, thestereoscopic display apparatus 100 detects whether or not the operatingtool F has been removed from the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S116). Inthe case the operating tool F has been removed from the display screenof the stereoscopic display unit 104, the stereoscopic display apparatus100 proceeds with the process to step S117. On the other hand, in thecase the operating tool F has not been removed from the display screenof the stereoscopic display unit 104, the stereoscopic display apparatus100 returns the process to step S116.

When the process proceeds to step S117, the stereoscopic displayapparatus 100 switches the display mode of the display object that isnon-stereoscopically displayed to stereoscopic display (S117).Additionally, an explanation is given here assuming that the operatingtool F contacts the display screen of the stereoscopic display unit 104,but in the case the operating tool F is removed from the display screenafter the display mode of the display object is made non-stereoscopicdisplay in step S113, the process of step S117 is performed.

In the foregoing, an operation of the stereoscopic display apparatus 100according to a modified example of the present embodiment has beendescribed.

(1-2-2: (#2) Inward Pushing of Display Object)

Next, FIG. 7 will be referred to. The display control method which willbe described here is for pushing a display object that isstereoscopically displayed inward into the display screen when anoperating tool F nears the display screen of the stereoscopic displayunit 104. FIG. 7 is an explanatory diagram for describing this displaycontrol method. Additionally, in FIG. 7, a stereoscopic display objectthat is seen by a user is schematically shown.

It is assumed as shown in FIG. 7 that a display object isstereoscopically displayed outward from the display screen by thestereoscopic display unit 104 (Step. 1). When an operating tool F nearsthe display screen of this stereoscopic display unit 104 (Step. 2), thedisplay control unit 102 displays the display object in such a way thatthe display object that is stereoscopically displayed is pushed inwardinto the display screen (Step. 3). If the display object is pushedinward into the display screen in Step. 3, the display object will notpop outward from the display screen, and thus the operating tool F willnot be displayed buried in the display object and no mismatch will occurbetween the sense of distance to the display object and the sense ofdistance to the operating tool F. As a result, an odd feelingexperienced by a user when the operating tool F nears the display objectthat is stereoscopically displayed can be reduced.

In the foregoing, the display control method according to the presentembodiment has been described.

Next, FIG. 8 will be referred to. FIG. 8 is an explanatory diagramshowing an operation of the stereoscopic display apparatus 100 forrealizing the display control method which has been described withreference to FIG. 7.

As shown in FIG. 8, the stereoscopic display apparatus 100stereoscopically displays a display object on the stereoscopic displayunit 104 by using a function of the display control unit 102 (S201).Next, the stereoscopic display apparatus 100 detects whether or not anoperating tool F has neared the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S202). Inthe case an operating tool F has neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100proceeds with the process to step S203. On the other hand, in the casean operating tool F has not neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100returns the process to step S202.

When the process proceeds to step S203, the stereoscopic displayapparatus 100 stereoscopically displays, inward into the display screen,the display object that is stereoscopically displayed outward from thedisplay screen, by using a function of the display control unit 102(S203). That is, the stereoscopic display apparatus 100 pushes, inwardinto the display screen, the display object that is stereoscopicallydisplayed outward from the display screen. Then, the stereoscopicdisplay apparatus 100 detects whether or not the operating tool F hasbeen removed from the display screen of the stereoscopic display unit104, by using a function of the touch panel 101 (S204).

In the case the operating tool F has been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 proceeds with the process to step S205. On the other hand,in the case the operating tool F has not been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 returns the process to step S204. When the 16 processproceeds to step S205, the stereoscopic display apparatus 100stereoscopically displays, outward from the display screen, the displayobject which has been pushed inward into the display screen, by using afunction of the display control unit 102 (S205).

In the foregoing, an operation of the stereoscopic display apparatus 100according to the present embodiment has been described.

Modified Example

Next, FIG. 9 will be referred to. FIG. 9 is a modified example of thedisplay control method shown in FIG. 7. The display control method whichwill be described here is for pushing a display object inward into thedisplay screen when an operating tool F nears the display screen, andpushing the display object further inward when the operating tool Fcontacts the display screen. That is, this display control method is forpushing the display object inward into the display screen discretelyaccording to the distance between the display screen and the operatingtool F. FIG. 9 is an explanatory diagram for describing this displaycontrol method. Incidentally, only the operations following Step. 1 andStep. 2 shown in FIG. 7 are shown in FIG. 9. Thus. FIG. 7 will bereferred to in relation to the operations of Step. 1 and Step. 2.

It is assumed as shown in FIG. 7 that a display object isstereoscopically displayed outward from the display screen by thestereoscopic display unit 104 (Step. 1). When an operating tool F nearsthe display screen of this stereoscopic display unit 104 (Step. 2), thedisplay control unit 102 displays the display object, that isstereoscopically displayed, in such a way that the display object ispushed inward into the display screen (Step. 3). Then, as shown in FIG.9, when the operating tool F contacts the display screen of thestereoscopic display unit 104, the display control unit 102 pushes,further inward, the display object that is displayed inward into thedisplay screen (Step. 4). For example, the depth of a display object inthe foremost layer is made zero relative to the display screen in Step.3, and the display object in the foremost layer is displayed inward intothe display screen in Step. 4.

In a case the display object is small, the display object may be hiddenby the operating tool F when the operating tool F contacts the displayscreen of the stereoscopic display unit 104. However, as shown in FIG.9, with a display object in the foremost layer being pushed inward intothe display screen following contact of the operating tool F, all thedisplay objects are prevented from being hidden by the operating tool F.In FIG. 9, the display object is schematically displayed so as to bevisible to a user, but in reality, the display object for a right eyeand the display object for a left eye are displayed projecting on theleft and right of the operating tool F. Accordingly, even if the displayobject is small, the display object will not be completely hidden by theoperating tool F.

Such a display control method functions effectively in a situation wherea display object, such as a button object, a menu object or the like, isto be operated by the operating tool F. This display control methodfunctions effectively also in a situation where operation is performedover a certain period of time with the display object being contacted.For example, in a case of dragging the display object, the operatingtool F has to be moved while being in contact with the display object.In such a case, if the display object is hidden by the operating tool F,it becomes difficult to see whether or not the display object is incontact with the operating tool F. However, when the display controlmethod described above is applied, the movement of the display objectmoving following the operating tool F can be seen, and a user canconfidently perform a drag operation.

In the foregoing, a modified example of the display control methodaccording to the present embodiment has been described.

Next, FIG. 10 will be referred to. FIG. 10 is an explanatory diagramshowing an operation of the stereoscopic display apparatus 100 forrealizing the display control method which has been described withreference to FIGS. 7 and 9.

As shown in FIG. 10, the stereoscopic display apparatus 100stereoscopically displays a display object on the stereoscopic displayunit 104 by using a function of the display control unit 102 (S211).Then, the stereoscopic display apparatus 100 detects whether or not anoperating tool F has neared the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S212). Inthe case an operating tool F has neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100proceeds with the process to step S213. On the other hand, in the casean operating tool F has not neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100returns the process to step S212.

When the process proceeds to S213, the stereoscopic display apparatus100 pushes, inward into the display screen, the display object that isdisplayed outward from the display screen, by using a function of thedisplay control unit 102 (S213). Then, the stereoscopic displayapparatus 100 detects whether or not the operating tool F has contactedthe display screen of the stereoscopic display unit 104, by using afunction of the touch panel 101 (S214). In the case the operating tool Fhas contacted the display screen of the stereoscopic display unit 104,the stereoscopic display apparatus 100 proceeds with the process to stepS215. On the other hand, in the case the operating tool F has notcontacted the display screen of the stereoscopic display unit 104, thestereoscopic display apparatus 100 returns the process to step S214.

When the process proceeds to step S215, the stereoscopic displayapparatus 100 pushes, further inward, the display object that isdisplayed inward into the display screen, by using a function of thedisplay control unit 102 (S215). For example, the depth of a displayobject in the foremost layer is made zero relative to the display screenin step 213, and the display object in the foremost layer is displayedinward into the display screen in step S215.

Then, the stereoscopic display apparatus 100 detects whether or not theoperating tool F has been removed from the display screen of thestereoscopic display unit 104, by using a function of the touch panel101 (S216). In the case the operating tool F has been removed from thedisplay screen of the stereoscopic display unit 104, the stereoscopicdisplay apparatus 100 proceeds with the process to step S217. On theother hand, in the case the operating tool F has not been removed fromthe display screen of the stereoscopic display unit 104, thestereoscopic display apparatus 100 returns the process to step S216.

When the process proceeds to step S217, the stereoscopic displayapparatus 100 stereoscopically displays, outward from the displayscreen, the display object that is displayed inward into the displayscreen (S217). Additionally, an explanation is given here assuming thatthe operating tool F contacts the display screen of the stereoscopicdisplay unit 104, but in the case the operating tool F is removed fromthe display screen after the display object is displayed inward into thedisplay screen in step S213, the process of step S217 is performed.

In the foregoing, an operation of the stereoscopic display apparatus 100according to a modified example of the present embodiment has beendescribed.

(1-2-3: (#3) Blurry Display of Display Object)

Next, FIG. 11 will be referred to. The display control method which willbe described here is for blurrily displaying when an operating tool Fnears the display screen of the stereoscopic display unit 104, a displayobject which is stereoscopically displayed. FIG. 11 is an explanatorydiagram for describing this display control method. Additionally, astereoscopic display object that is seen by a user is schematicallyshown in FIG. 11.

It is assumed as shown in FIG. 11 that a display object isstereoscopically displayed outward from the display screen by thestereoscopic display unit 104 (Step. 1). When an operating tool F nearsthe display screen of this stereoscopic display unit 104 (Step. 2), thedisplay control unit 102 blurrily displays the display object that isstereoscopically displayed (Step. 3). For example, the outline of thedisplay object is blurrily displayed.

When the outline of the display object is blurred, the degree of pop-outof the display object becomes hard to perceive. Thus, when the displayobject is blurrily displayed in Step. 3, the sense of distance betweenthe display screen and the display object becomes unclear, and themismatch between the sense of distance to the display object and thesense of distance to the operating tool F is less apt to be felt. As aresult, an odd feeling experienced by a user when the operating tool Fnears the display object that is stereoscopically displayed can bereduced.

In the foregoing, the display control method according to the presentembodiment has been described.

Next, FIG. 12 will be referred to. FIG. 12 is an explanatory diagramshowing an operation of the stereoscopic display apparatus 100 forrealizing the display control method which has been described withreference to FIG. 11.

As shown in FIG. 12, the stereoscopic display apparatus 100stereoscopically displays a display object on the stereoscopic displayunit 104 by using a function of the display control unit 102 (S301).Next, the stereoscopic display apparatus 100 detects whether or not anoperating tool F has neared the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S302). Inthe case an operating tool F has neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100proceeds with the process to step S303. On the other hand, in the casean operating tool F has not neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100returns the process to step S302.

When the process proceeds to step S303, the stereoscopic displayapparatus 100 blurrily displays the display object that isstereoscopically displayed, by using a function of the display controlunit 102 (S303). For example, the stereoscopic display apparatus 100blurrily displays the outline of the display object. Then, thestereoscopic display apparatus 100 detects whether or not the operatingtool F has been removed from the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S304).

In the case the operating tool F has been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 proceeds with the process to step S305. On the other hand,in the case the operating tool F 256 has not been removed from thedisplay screen of the stereoscopic display unit 104, the stereoscopicdisplay apparatus 100 returns the process to step S304. In the case theprocess proceeds to step S305, the stereoscopic display apparatus 100clearly displays the display object that is blurrily displayed, by usinga function of the display control unit 102 (S305).

In the foregoing, an operation of the stereoscopic display apparatus 100according to the present embodiment has been described.

Modified Example

Next, FIG. 13 will be referred to. FIG. 13 is a modified example of thedisplay control method shown in FIG. 11. The display control methodwhich will be described here is for switching the display mode of adisplay object positioned near an operating tool F to non-stereoscopicdisplay and blurrily displaying a display object, that is, content,positioned away from the operating tool F when the operating tool Fnears the display screen of the stereoscopic display unit 104. FIG. 13is an explanatory diagram for describing this display control method.

It is assumed as shown in FIG. 13 that a display object isstereoscopically displayed by the stereoscopic display unit 104 (Step.1). When an operating tool F nears the display screen of thisstereoscopic display unit 104 (Step. 2), the display 16 control unit 102switches the display mode of a display object that is positioned nearthe operating tool F to non-stereoscopic display and blurrily displays adisplay object that is positioned away from the operating tool F (Step.3).

By switching stereoscopic display to non-stereoscopic display in thismanner, the operating tool F will not be buried in the display objectand no mismatch will occur between the sense of distance to theoperating tool F and the sense of distance to the display object. Also,with the display object being blurrily displayed, the sense of distanceto the display object becomes unclear, and thus an odd feelingexperienced by a user due to the mismatch occurring between the sense ofdistance to the operating tool F and the sense of distance to thedisplay object can be reduced.

In the foregoing, a modified example of the display control methodaccording to the present embodiment has been described.

Next, FIG. 14 will be referred to. FIG. 14 is an explanatory diagramshowing an operation of the stereoscopic display apparatus 100 forrealizing the display control method which has been described withreference to FIG. 13.

As shown in FIG. 14, the stereoscopic display apparatus 100stereoscopically displays a display object on the stereoscopic displayunit 104 by using a function of the display control unit 102 (S311).Then, the stereoscopic display apparatus 100 detects whether or not anoperating tool F has neared the display screen of the stereoscopicdisplay unit 104, by using a function of the touch panel 101 (S312). Inthe case an operating tool F has neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100proceeds with the process to step S313. On the other hand, in the casean operating tool F has not neared the display screen of thestereoscopic display unit 104, the stereoscopic display apparatus 100returns the process to step S312.

When the process proceeds to step S313, the stereoscopic displayapparatus 100 non-stereoscopically displays a display object positionednear the operating tool F and blurrily displays a display objectpositioned away from the operating tool F, by using a function of thedisplay control unit 102 (S313). Then, the stereoscopic displayapparatus 100 detects whether or not the operating tool F has beenremoved from the display screen of the stereoscopic display unit 104, byusing a function of the touch panel 101 (S314).

In the case the operating tool F has been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 proceeds with the process to step S315. On the other hand,in the case the operating tool F has not been removed from the displayscreen of the stereoscopic display unit 104, the stereoscopic displayapparatus 100 returns the process to step S314. In the case the processproceeds to step S315, the stereoscopic display apparatus 100stereoscopically displays the display object that isnon-stereoscopically displayed and clearly displays the display objectthat is blurrily displayed, by using a function of the display controlunit 102 (S31).

In the foregoing, an operation of the stereoscopic display apparatus 100according to a modified example of the present embodiment has beendescribed.

In the foregoing, an embodiment of the present disclosure has beendescribed. As described above, by appropriately controlling the displaymode of a display object according to nearing or contacting of anoperating tool F, an odd feeling experienced by a user because of amismatch occurring between the sense of distance to the display objectthat is stereoscopically displayed and the sense of distance to theoperating tool F can be reduced.

Additionally, the display control methods described above can be appliedin appropriate combination. Also, the display control methods may beseparately used according to the type of the display object; forexample, the display control method of blurrily displaying a displayobject according to nearing of an operating tool F is applied to adisplay object displayed in a status display area such as a remainingbattery display or a time display, and a display control method ofpushing a display object inward into the display screen according tonearing of the operating tool F is applied to a display object such as aGUI.

Furthermore, in the explanation above, a method of detecting threestates, non-proximity, proximity and contact, by the touch panel 101 andcontrolling the display mode of a display object according to thedetection result has been described.

However, the display control method according to the present embodimentis not limited to such a method. For example, in the case the distancebetween the display screen and the display object can be discretely orsuccessively detected by the touch panel 101, it is possible todiscretely or successively push the display object deeper in the depthdirection or to discretely or successively increase the degree ofblurring, according to the distance. Such modifications are alsoincluded in the technical scope of the present embodiment.

[1-3: Hardware Configuration]

The function of each structural element of the stereoscopic displayapparatus 100 described above can be installed, for example, in aninformation processing apparatus shown in FIG. 15. Furthermore, thefunction of each structural element is realized by controlling thehardware shown in FIG. 15 using a computer program. Additionally, themode of this hardware is arbitrary, and it may be a personal computer, amobile information terminal such as a mobile phone, a PHS or a PDA, agame machine, or various types of information appliances. Moreover, thePHS is an abbreviation for Personal Handy-phone System. Also, the PDA isan abbreviation for Personal Digital Assistant.

As shown in FIG. 15, this hardware mainly includes a CPU 902, a ROM 904,a RAM 906, a host bus 908, and a bridge 910. Furthermore, this hardwareincludes an external bus 912, an interface 914, an input unit 916, anoutput unit 918, a storage unit 920, a drive 922, a connection port 924,and a communication unit 926. Moreover, the CPU is an abbreviation forCentral Processing Unit. Also, the ROM is an abbreviation for Read OnlyMemory. Furthermore, the RAM is an abbreviation for Random AccessMemory.

The CPU 902 functions as an arithmetic processing unit or a controlunit, for example, and controls entire operation or a part of theoperation of each structural element based on various programs recordedon the ROM 904, the RAM 906, the storage unit 920, or a removalrecording medium 928. The ROM 904 is means for storing, for example, aprogram to be loaded on the CPU 902 or data or the like used in anarithmetic operation. The RAM 906 temporarily or perpetually stores, forexample, a program to be loaded on the CPU 902 or various parameters orthe like arbitrarily changed in execution of the program.

These structural elements are connected to each other by, for example,the host bus 908 capable of performing high-speed data transmission. Forits part, the host bus 908 is connected through the bridge 910 to theexternal bus 912 whose data transmission speed is relatively low, forexample. Furthermore, the input unit 916 is, for example, a mouse, akeyboard, a touch panel, a button, a switch, or a lever. Also, the inputunit 916 may be a remote control that can transmit a control signal byusing an infrared ray or other radio waves.

The output unit 918 is, for example, a display device such as a CRT, anLCD, a PDP or an ELD, an audio output device such as a speaker orheadphones, a printer, a mobile phone, or a facsimile, that can visuallyor auditorily notify a user of acquired information. Moreover, the CRTis an abbreviation for Cathode Ray Tube. The LCD is an abbreviation forLiquid Crystal Display. The PDP is an abbreviation for Plasma DisplayPanel. Also, the ELD is an abbreviation for Electro-LuminescenceDisplay.

The storage unit 920 is a device for storing various data. The storageunit 920 is, for example, a magnetic storage device such as a hard diskdrive (HDD), a semiconductor storage device, an optical storage device,or a magneto-optical storage device. The HDD is an abbreviation for HardDisk Drive.

The drive 922 is a device that reads information recorded on the removalrecording medium 928 such as a magnetic disk, an optical disk, amagneto-optical disk, or a semiconductor memory, or writes informationin the removal recording medium 928. The removal recording medium 928is, for example, a DVD medium, a Blu-ray medium, an HD-DVD medium,various types of semiconductor storage media, or the like. Of course,the removal recording medium 928 may be, for example, an electronicdevice or an IC card on which a non-contact IC chip is mounted. The ICis an abbreviation for Integrated Circuit.

The connection port 924 is a port such as an USB port, an IEEE1394 port,a SCSI, an RS-232C port, or a port for connecting an externallyconnected device 930 such as an optical audio terminal. The externallyconnected device 930 is, for example, a printer, a mobile music player,a digital camera, a digital video camera, or an IC recorder. Moreover,the USB is an abbreviation for Universal Serial Bus. Also, the SCSI isan abbreviation for Small Computer System Interface.

The communication unit 926 is a communication device to be connected toa network 932, and is, for example, a communication card for a wired orwireless LAN, Bluetooth (registered trademark), or WUSB, an opticalcommunication router, an ADSL router, or various communication modems.The network 932 connected to the communication unit 926 is configuredfrom a wire-connected or wirelessly connected network, and is theInternmet, a home-use LAN, infrared communication, visible lightcommunication, broadcasting, or satellite communication, for example.Moreover, the LAN is an abbreviation for Local Area Network. Also, theWUSB is an abbreviation for Wireless USB. Furthermore, the ADSL is anabbreviation for Asymmetric Digital Subscriber Line.

2: SUMMARY

Lastly, the technical contents according to the embodiment of thepresent disclosure will be briefly described. The technical contentsstated here can be applied to various information processingapparatuses, such as a personal computer, a mobile phone, a portablegame machine, a portable information terminal, an information appliance,a car navigation system, and the like.

The functional configuration of the information processing apparatusdescribed above can be expressed as below. The information processingapparatus includes a stereoscopic display unit, a proximity detectionunit, and a display control unit as below. The stereoscopic display unitis means for stereoscopically displaying a display object. Furthermore,the proximity detection unit is means for detecting nearing of anoperating tool to the stereoscopic display unit. For example, thestereoscopic display unit can display objects used for operation, suchas a button object and a menu object. Also, when a user nears anoperating tool to an object used for operation, the proximity detectionunit can detect the nearing of the operating tool to the object used foroperation. That is, by using the stereoscopic display unit and theproximity detection unit in combination, a touch operation using anoperating tool becomes possible.

However, when a display object that is stereoscopically displayed andthe operating tool in the real world overlap each other at the time ofthe touch operation, a mismatch occurs between the senses of distanceperceived by a user. For example, with regard to a display objectdisplayed popping outward from a display screen, the operating tool willbe displayed buried in the display object, and thehiding-and-being-hidden relationship between the operating tool and thedisplay object will be lost. On the other hand, with regard to a displayobject that is displayed inward into the display screen, therelationship between the focal point of crystalline lenses for theoperating tool and the focal point for the display object is lost. Forthese reasons, a user will experience an odd feeling with regard to therelationship between the operating tool and the display object.

To alleviate such an odd feeling, the display control unit describedabove causes, when nearing of the operating tool is detected by theproximity detection unit, the display object displayed on thestereoscopic display unit to be displayed inward into a display screenof the stereoscopic display unit, for example. That is, a display objectthat is displayed and that is most popped out will be displayed inwardinto the display screen, and other display objects will be displayedfurther inward. Therefore, no display object will be displayed beforethe operating tool. As a result, a mismatch, regarding the sense ofdistance, occurring between a display object that is stereoscopicallydisplayed and an operating tool in the real world will be unnoticeable,and an odd feeling experience by a user can be alleviated.

Furthermore, as another configuration for alleviating an odd feeling asdescribed above, the display control unit described above may beconfigured to cause, when nearing of the operating tool is detected bythe proximity detection unit, the display object displayed on thestereoscopic display unit to be displayed non-stereoscopically, forexample. If the display object is non-stereoscopically displayed, nomismatch will occur between the display object and the operating toolthat has neared regarding the sense of distance, and there will be noodd feeling which is experienced by a user in a state where the displayobject is stereoscopically displayed. That is, by applying theconfiguration of the display control unit as described above, it becomespossible to avoid the mismatch, regarding the sense of distance, betweena display object and an operating tool in the real world occurring atthe time the operating tool is brought near the display screen by auser.

Furthermore, as another configuration for alleviating an odd feeling asdescribed above, the display control unit described above may beconfigured to cause, when nearing of the operating tool is detected bythe proximity detection unit, the display object displayed on thestereoscopic display unit to be blurrily displayed, for example. When adisplay object is blurrily displayed, it becomes difficult for a user toaccurately perceive the sense of distance between the display object andthe display screen. When making use of this effect, it becomes possibleto reduce the mismatch, regarding the sense of direction, between adisplay object and the operating tool in the real world. That is, byapplying the configuration of the display control unit as describedabove, the mismatch, regarding the sense of distance, between a displayobject that is stereoscopically displayed and the operating tool in thereal world will be unnoticeable, and an odd feeling experience by a usercan be alleviated.

NOTES

The touch panel 101 described above is an example of a proximitydetection unit. The stereoscopic display apparatus 100 described aboveis an example of an information processing apparatus.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

1-18. (canceled)
 19. An information processing apparatus, comprising:circuitry configured to control: displaying a first content object at afirst outward 3D position at a first distance from a device; detecting asecond outward 3D position of an operating member; and altering displayof the first content object based on an object type of the first contentobject and a relation of the first content object to the operationmember.
 20. The information processing apparatus of claim 19, whereinthe circuitry is further configured to control displaying a secondcontent object at a third outward 3D position at a second distance fromthe device, the second content object having a different object typethan the first content object.
 21. The information processing apparatusof claim 20, wherein the object type of the first content objectcomprises a graphical user interface (GUI) which is operated by theoperating member.
 22. The information processing apparatus of claim 21,wherein the GUI comprises at least one button object, and wherein thefirst content object is operated by the operating member based on therelation to the operation member.
 23. The information processingapparatus of claim 21, wherein the altering display of the first contentobject comprises displaying the first content object at a third distancefrom the device.
 24. The information processing apparatus of claim 23,wherein the displaying the first content object at the third distancecomprises displaying the first content object in an inward 3D positionat the third distance.
 25. The information processing apparatus of claim23, wherein the third distance is smaller than the first distance. 26.The information processing apparatus of claim 25, wherein the thirddistance is substantially zero, and wherein the displaying the firstcontent object at the third distance comprises displaying the firstcontent object at a 2D position on a face of the device.
 27. Theinformation processing apparatus of claim 25, wherein the object type ofthe second content object comprises at least one of video data, imagedata, or an object for status information.
 28. The informationprocessing apparatus of claim 27, wherein the circuitry is furtherconfigured to control altering display of the second content objectbased on the object type of the second content object and a relation ofthe second content object to the operation member.
 29. The informationprocessing apparatus of claim 28, wherein the second outward 3D positionof the operating member is located at a fourth distance from the device,and wherein the displaying the first content object at the thirddistance is executed when the fourth distance is less than orsubstantially equal to the first distance.
 30. The informationprocessing apparatus of claim 29, wherein the altering display of thefirst content object comprises displaying the first content object at afifth distance from the device after the first display content object isdisplayed at the third distance, and wherein the fifth distance islarger than the third distance.
 31. The information processing apparatusof claim 30, wherein the fifth distance is substantially equal to thefirst distance, and wherein the displaying the first content object atthe fifth distance comprises displaying the first content object at thefirst outward 3D position at the first distance.
 32. The informationprocessing apparatus of claim 28, wherein the altering display of thesecond content object comprises displaying the second content object atrelatively low image quality, wherein the second outward 3D position ofthe operating member is located at a fourth distance from the device,and wherein the displaying the second content object at the relativelylow image quality is executed when the fourth distance is less than orsubstantially equal to the second distance.
 33. The informationprocessing apparatus of claim 32, wherein the relatively low imagequality is a blurry image quality.
 34. The information processingapparatus of claim 32, wherein the object type of the second contentobject comprises the object for status information.
 35. The informationprocessing apparatus of claim 32, wherein the object type of the firstcontent object is the GUI, and wherein the object type of the secondcontent object is the object for status information.
 36. The informationprocessing apparatus of claim 19, wherein the device comprises a displayscreen.
 37. An information processing method, implemented via at leastone processor, the method comprising: displaying a first content objectat a first outward 3D position at a first distance from a device;detecting a second outward 3D position of an operating member; andaltering display of the first content object based on an object type ofthe first content object and a relation of the first content object tothe operation member.
 38. A non-transitory computer-readable mediumhaving embodied thereon a program, which when executed by a computercauses the computer to execute a method, the method comprising:displaying a first content object at a first outward 3D position at afirst distance from a device; detecting a second outward 3D position ofan operating member; and altering display of the first content objectbased on an object type of the first content object and a relation ofthe first content object to the operation member.